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I . Introduction 

However  difficult  the  fundamental  problems  of  theoretical  computer  science 
ma>  seem,  there  is  very  little  to  suggest  that  they  are  anything  more  than 
knotty  combinatorial  problems.  So,  when  we  look  for  reasons  for  our  inability 
to  resolve  P = NP  and  related  questions,  we  most  likely  find  them  dealing  with 
a lack  of  understanding  of  particular  computational  problems  and  their  lower 
bounds.  This  is  the  sense  of  Hopcroft's  prediction:  "...within  the  next  five 

years,  nobody  will  prove  that  any  of  these  problems  takes  more  than  let's  say 

2 

n time.  I think  that's  a reasonably  safe  conjecture  and  It  also  illustrates 
how  little  we  know  about  lower  bounds."  [MT].  Hopcroft's  guess  is  uncanny 
in  its  accuracy  --  after  six  years  and  considerable  effort  by  many  researchers, 
his  conjecture  remains  unchal langed. 

The  results  in  this  paper  offer  a possible  explanation  for  our  failure 
to  resolve  these  problems.  Roughly,  the  main  result  of  the  sequel  links 
lower  bounds  and  a branch  of  mathematical  logic  known  as  model  theory.  In  par- 
ticular, we  prove  that  the  existence  of  nonpolynomial  lower  bounds  is  equiv- 
alent to  the  existence  of  nonstandard  models  of  a sizable  fragment  of 
arithmetic.  Since  these  are  deep  logical  issues  and  there  are  very  few  tech- 
niques for  handling  them,  and  since  the  nonstandard  models  in  question  are  non- 
effective,  it  seems  plausible  that  this  linking  of  complexity  theory  and  logic 
explains  our  failure  to  obtain  nontrivial  lower  bounds. 

One  of  the  aims  of  mathematical  logic  is  to  clarify  the  relation  between 
mathematical  theories  and  their  interpretations  --  or  models.  In  logic,  a 
theory  is  simply  a collection  of  statements  and  all  of  their  logical  consequences, 
that  is,  a collection  of  (nonlogical)  axioms  closed  under  the  relation 
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Models  are  the  structures  In  which  theories  are  Interpreted. 

Plane  geometry  Is  such  a mathematical  theory.  In  antiquity,  the  relation 
between  Euclidean  geometry  and  its  models  was  considered  obvious,  and  this 
relationship  was  even  further  clarified  by  the  arithmetizatlon  of  geometry. 

It  was  therefore  a shock  to  the  mathematical  world  when.  In  1868,  Beltrami 
announced  that  geometry  can  have  more  than  one  model  --  a very  strange  one 
at  that  since  In  his  model  the  parallel  postulate  is  false.  Since  the  parallel 
postulate  Is  certainly  true  in  the  standard  model  of  geometry,  its  negation  Is 
not  provable  --  the  parallel  postulate  is  consistent  with  Euclidean  geometry. 

On  the  other  hand,  since  the  negation  of  the  parallel  postulate  Is  also  true 
In  a (nonstandard)  model,  its  negation  (i.e.,  the  parallel  postulate  Itself) 

Is  not  provable.  More  recently,  Cohen  [Co]  proved  that  both  the  axiom  of 
choice  and  general ized  continuum  hypothesis  cannot  be  proved  from  the  remain- 
ing axioKis  of  set  theory  --  Cohen  introduced  a radically  new  concept  called 
forcing  to  construct  nonstandard  models  with  prescribed  properties.  The  first 
such  result  for  formal  arithmetic  was  obtained  by  Paris  and  Harrington  [PH]. 
They  proved  that  a modest  generalization  of  the  finite  Ramsey  theorem  of 
combinatorics  is  not  decided  by  Peano  arithmetic.  Sheperdson  [Sh]  discusses 
the  unprovability  of  induction  schemes  and  such  statements  as  Fermat's  Last 
Theorem,  for  the  case  n 3 3,  from  weak  fragments  of  arithmetic. 

This  property  of  statements  of  a theory  is  called  independence:  a 
statement  is  Independent  from  a theory  T If  the  statement  cannot  be  proved 

II 

or  disproved  within  T.  Of  course,  Godel  proved  that  every  sufficiently 
powerful  theory  must  leave  infinitely  many  statements  unresolved  in  this  way. 

In  current  terminology,  however,  a qualitative  distinction  is  usually  drawn 
between  formal  undecidablllty  and  interesting  independence  theorems.  In  the 


Godel-style  formal  undecidability  theorems,  one  explicitly  formulates  a 
diagonalizing  statement  and  using  the  properties  of  the  axiom  system  in 
question,  encodes  that  statement  as  a formal  statement  of  the  theory.  In 
independence  results  whatever  diagonal ization  is  present  in  the  proof,  is 
well-hidden.  One  begins  with  a fixed  (true)  formal  statement  --  whose 
formal ization  has  not  been  obtained  with  a knowledge  of  the  axioms  to  be  used  — 
and  using  model  theoretic  techniques,  shows  an  interpretation  in  which  the 
statement  fails  to  hold  (cf.  [DL]  for  a survey  of  these  results).  Therefore, 
independence  results  seem  to  exhibit  the  following  characteristics. 

(1)  There  is  no  direct  diagonal ization.  That  is,  the  statements 
whose  independence  is  to  be  proved  do  not  refer  explicitly  to, 
say,  halting  computations. 

(2)  The  independent  statements  are  interesting  in  their  own  right. 

In  set  theory,  for  instance,  independent  statements  often  rep- 
resent useful  infinitary  combinatorial  principles. 

(3)  The  independence  of  a statement  is  sensitive  to  the  underlying 
theory.  In  formal  undecidabil ity  results  one  can  add  additional 
axioms  to  the  theory,  encode  the  independent  statement  for  the 
new  theory  and  retain  its  undecidability.  In  interesting  inde- 
pendent theorems,  however,  the  independence  of  the  statement  from 
a set  of  axioms  characterizes  the  power  of  the  axioms;  changing 
the  underlying  theory  by  adding  more  axioms  decides  the  statement 
in  the  expanded  theory. 

Except  for  the  discussion  of  Hopcroft  and  Hartmanis  [HH]  and  the  results 
of  Upton  [Li],  we  are  aware  of  no  other  results  that  relate  the  basic  issues 
of  complexity  theory  to  independence  or  nonstandard  models.  The  impact  of 
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our  results  is  that  proving  lower  bounds  on  certain  computational  problems 
as  hard  as  showing  that  a certain  true  sentence  is  independent  from  a 
powerful  theory.  In  particular,  we  show  that  for  certain  S,  S i P (i.e.,  S 
is  intractible)  exactly  when  a particular  true  sentence  A<.  related  to  S must 

be  false  in  a nonstandard  model  of  arithmetic.  Furthermore-,  this  model  must 
be  noneffective.  The  various  proofs  of  this  result  yield  existential  proof 
techniques  for  showing  that  problems  are  solvable  in  polynomial  time.  An 
interesting  aspect  of  this  result  is  that  it  apparently  does  not  generalize 
much  beyond  polynomial  time  computation.  That  is,  it  does  not  relativize  in 
any  obvious  way,  nor  is  it  possible  to  formally  substitute  many  other  time 
classes  for  P in  the  statement  of  the  theorem. 

H.  Definitions 

The  definitions  from  complexity  theory  are  standard  [BL] . P denotes  the 
set  of  problems  solvable  in  deterministic  polynomial  time.  NP  denotes  the 
problems  solvable  in  nondeterministic  polynomial  time,  and  coNP  denotes  the 
set  of  problems  whose  complements  lie  within  NP.  The  inclusions 

Pc  NPn  CONP  C NP 

are  obvious.  Although  it  is  widely  believed  that  both  inclusions  are  strict, 
the  results  to  be  quoted  below  are  interesting  even  if,  say,  P = NP  n coNP. 

We  will  return  to  this  point  later. 

Our  logical  notation  is  standard  (see  [Ba]).  Our  language  is  any 
acceptable  first  order  language  with  arithmetical  symbols  and  quality.  We 
use  V for  universal  quantification  and  3 for  existential  quantification. 

Among  other  symbols,  x,y,z  are  used  for  variables,  and  the  infix  symbols 
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* and  ^ and  - are  used  for  addition  and  multiplication  and  subtraction,  sue 
and  pred  for  the  successor  and  predecessor  functions,  and  0 for  the  constant 
zero. 

Let  T be  a set  of  formulas,  then  T (-  $ indicates  that  $ is  a logical 
consequence  of  T.  A theory  is  simply  the  set  of  formulas  which  are  logical 
consequences  of  T.  Since  the  set  of  theorems  of  the  theory  is  uniquely  char- 
acterized by  T,  we  identify  the  two.  A theory  is  consistent  if  0=1  is  not 
amonq  its  theorems.  A formula  4>  is  independent  of  the  theory  if  neither  $ 
nor  ^ is  a theorem.  If  T is  a theory,  T+4>  denotes  the  result  of  adjoining 
$ as  an  axiom.  Thus  $ is  independent  of  T if  both  T+i}>  and  are  consistent. 
A model  of  a theory  T is  an  interpretation  of  the  Individuals,  functions  and 
relations  of  the  underlying  language  such  that  each  ^ e T is  true.  A set 
of  formulas  has  a model  if  and  only  if  it  is  consistent.  In  addition  to  this 
basic  fact,  we  will  use  the 

Compactness  Theorem  [BS]:  Let  T be  a set  of  formulas.  T has  a model  iff 
every  finite  subset  of  T has  a model. 

We  will  deal  with  a subtheory  of  (complete)  arithmetic.  Of  course  the 
standard  model  of  this  theory  is  the  integers  N = (0,1,2,...)  with  the  remain- 
ing symbols  interpreted  in  the  obvious  way.  Any  model  *N  (with  + interpreted 
as  *+,  etc.)  which  is  not  isomorphic  to  N is  said  to  be  nonstandard.  Since 
*N  may  be  uncountable  it  is  not  surprising  that  nonstandard  models  of 
arithmetic  can  exist.  Skolem  [SK],  however,  showed  that  countable  non- 
standard models  are  possible.  We  will  discuss  these  more  fully  in  Section  IV. 
For  now  it  will  be  sufficient  to  note  that  if  *N  is  a countable  nonstandard 
model  of  arithmetic  *N-N  consists  of  nonstandard  objects  which  are  infinite 
relative  to  N;  i.e.,  if  a e *N-N,  a > n,  for  each  M e N.  Henceforth 
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*N  (or  *Ng,*Np  always  denotes  such  a model. 

We  will  now  define  a particular  theory  PT.  The  language  for  PT  includes 
symbols  for  all  the  functions  and  predicates  which  are  countable  in  poly- 
nomial time.  The  axioms  of  PT  are  all  true  sentences  of  the  form 

(3x)(Vy)A(x,y), 

where  A is  quantifier-free  (as  usual  x and  y may  denote  several  occurrences 
of  bound  variables).  A formula  with  such  a quantifier  is  called  an  EA  formula. 
Similarly  an  AE  formula  contains  the  quantifier  prefix  V3  . The  theory  PT 
is  quite  powerful.  It  includes  the  theory  studied  by  Skolem  [Ski]  --  which 
he  felt  represented  an  important  part  of  constructive  number  theory.  Hilbert, 
Herbrand,  Kreisel  and  Scott  [Sc]  have  also  studied  systems  much  weaker  than 
PT  ( Sh] . Perhaps  more  relevant  to  our  discussion,  the  PV  system  of  Cook  [Ckl , 
Ck2]  is  also  weaker  than  PT.  The  axioms  of  PT  include  all  the  recursive 
equations  that  define  the  functions  and  predicates  Included  in  PT.  Moreover, 

PT  contains  the  Induction  axiom 

A(0)  A (\/x)[A(x)  -►  A(x+1 )]  -*■  (Vy)A(y).  (*) 

where  A is  a quanti fier-free.  To  see  this  just  note  that  (*)  is  equivalent 
to 

(ax)(vy)NUo)  v (a(x)  a vA(x+i))v  A(y)]. 

For  model-theoretic  purposes  the  axioms  PT  can  be  replaced  by  their  universal 
members  without  changing  the  degree  of  the  theory:  both  axiomatizations  are 
equivalent.  The  theory  which  Skolem  studied  can  be  formed  by  (*)  and  the 
recursive  definitions  of  the  functions  successor,  addition,  multiplication, 
subtraction  and  integer  division.  Cook's  PV  theory  is  related  to  PT,  but 
notice  that  PT  is  not  even  recursively  enumerable  (inclusion  of  an  axiom 
depends  upon  its  truth),  so  that  PT  is  a vastly  more  powerful  theory.  Indeed 


it  is  not  obvious  how  to  deal  with  independence  from  PT  using  other  than 
model -theoretic  techniques  --  since  PT  is  not  recursively  enumberable,  it 
is  not  clear  how  diagonalization  can  work  at  all.' 

Ml.  Main  Result 

Our  main  result  is  that  the  intractability  of  any  S c NP  n coNP  is 
equivalent  to  the  existence  of  a nonstandard  model  for  PT  in  which  a certain 
sentence  A^,  related  to  S,  fails;  i.e.,  PT  + is  a consistent  theory. 

Let  S be  fixed  and  let  A(x,y),  B(x,y)  be  defined  as  follows: 

(3y)A(x,y)  iff  x c S. 
and 

(3y( B(x,y)  iff  x t S. 

Now  form  A^(A.B) : 

AS(A,B)  » (Vx)[(3y)A(x,y)  v (3z)B(x,z)] 

Notice  that,  when  interpreted  in  N.  N |*  A<.(A,B)  since  in  N 

A<.(A,B)  •*-*•  (Vx)(xcSv  x^S). 

Theorem.  Let  S e NP  n coNP.  Then  the  following  statements  are  equivalent: 

(1)  S e P. 

(2)  PT  f-  A<.(A,B),  for  some  A,B  in  the  language  of  PT. 

Proof  of  (1)  » (2):  If  S c P,  there  are  polynomial  time  predicates  A,B  so 

that  x c S iff  A(x)  and  x t.  S iff  B(x). 
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(Vx)[(3y)A(x,i  V (3  2)8(x)j 


is  an  axiom  of  PT. 
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Proof  of  (2)  *>  (1 ) : 

We  will  present  three  proofs  of  the  converse.  What  is  needed  in  all  three 
cases  is  to  pass  from  PT  (~  a^(A,B)  to  a true  formula 


(Vx)(  V A(*ifj(x))  V .V^U.g^x))) 


where  the  terms  f^,g.  are  in  the  language  of  PT.  Hence  x e S is  decided  by 
checking 


V A(x,f.(x)) 
i=l  1 


(3) 


and 


m 


V ^B(x,gi (x)) 


(4) 


If  (3)  is  true  x e S and  if  (4)  is  true  x t S,  and  since  all  terms  and 
predicates  are  polynomial  time  computable,  S e P. 


Proof  A: 


Let  (Vx)(3y)r(x,y)  denote  AS(A,B),  so  that  PT  (-  (vx)(3y)r(x,y), 
and  suppose  that 

n 


PT  y (Vx)(V  r(x,f.(x)), 

i=l 


n-1 , 2 , • • • 
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where  fj^....  are  terms  of  PT.  Define  the  theory  T*  by 

T*  = PT  + 'vr(c,f-|  (c) ) ' ..+  ^r(c,fn(c))  +... 

where  c is  a new  constant,  not  appearing  in  PT.  We  first  claim  that  T*  is 
consistent,  for  if  not 

PT  + M’fc.f^c))  +...+  %r(c,fm(c))  (-  0=1 

by  compactness  and  hence 

pt  h V r(c,f.(c)) 

i=l  1 


which  implies 

m 

PT  h ‘(Vx)  v r(x,f.(x)), 
i=l  1 

establishing  the  claim.  Choose  any  model  M for  T*  and  let  Mc  be  the  submodel 
generated  by  c.  Since  PT  is  open,  Mc  (=  PT  and  thus  Mc  (3y)r(c,y).  But 

by  our  choice  of  c,  Mc  f=  (Vy)^r(c,y).  S e P now  follows  as  described  above. 

□ 

Proof  B: 

We  need  to  recall  the  following  fact,  often  called  the  Kleene-Herbrand- 
Gentzen  Theorem  [Kl], 

Lemma  If  T is  a consistent  collection  of  EA  formulas  and  T (-  fax)( 3 y )d>( x ,y ) 

where  is  open,  then  for  some  terms  over  the  terms  of  T,  their  compositions 

and  definition  by  cases,  say  f^,...,fm> 


« 
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m 

V 4>(x,f,(x)) 

1=1  1 

Is  true. 

Roughly  speaking,  this  allows  us  to  make  the  existential  quantifiers 
explicit  in  a quite  constructive  fashion.  Without  the  restriction  on  T the 
lemma  is  easily  seen  to  be  false.  Since  PT  satisfies  the  hypothesis  for  T 
and  A^(A,B)  is  AE,  S c P follows  by  (3),  (4)  as  described  above. 

□ 

Proof  C: 

The  application  of  the  Kleene-Herbrand-Gentzen  Theorem  can  be  replaced 
by  an  application  of  the  "pure"  Herbrand  Theorem  [Stl]  as  in  Proof  B to 
conclude  PT  (-■  "S  e P". 

□ 

Notice  that  Proof  A is  nonconstructive  and  involves  compactness  arguments. 

The  provability  of  AS(A,B)  in  this  setting  constitutes  a "pure"  existence  proof 

for  polynomial  time  algorithms.  The  provability  of  A<.(A,B)  in  the  setting  of 

Proofs  B and  C constitutes  a constructive  existence  proof  for  polynomial  time 
algorithms.  (The  apparent  simplicity  of  Proof  B compared  to  Proof  A lies  in 
the  great  power  of  Herbrand's  Theorem,  which  has  played  a basic  role  in 
various  consistency  proofs  in  logic.  The  proof  of  Herbrand's  Theorem  is  based 
on  a very  careful  analysis  of  how  T can  prove  '\/x)(3y)<J>(x,y)).  However,  the 
running  times  of  polynomial  time  algorithms  produced  in  this  way  may  be  very 
bad  indeed.  In  fact,  the  best  known  bound  is  of  order 

2 

2*’  (5) 

n2 
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where  the  depth  of  nesting  of  the  stack  of  2's  is  bounded  by  the  number  of 
inferences  in  the  shortest  proof  of  A^(A,B)  in  PT.  These  upper  bounds  are 

the  best  known  to  logicians,  although  the  lower  bound  literature  is  very 
sparse  (Statman  has  obtained  this  polynomial  as  a lower  bound  [St]  although 
for  a theory  much  less  relevant  to  complexity  theorists).  It  has  been  often 
noticed  that,  although  there  are  problems  with  very  large  polynomial 
running  times,  the  only  naturally  occuring  problems  in  P have  "small"  poly- 
nomial complexity.  This  gap  has  helped  to  sustain  a certain  feeling  that 
membership  in  P is  sufficient  for  computational  tractabil ity.  If  indeed  the 
polynomial  bounds  (5)  cannot  be  locally  reduced,  this  is  compelling  evidence 
that  P is  much  too  extensive 

This  theorem  above  does  not  apply  to  arbitrary  complexity  classes.  It 
is  apparently  rather  highly  specialized  for  polynomial -like  complexity  classes. 

At  concrete  levels,  the  theorem  can  be  made  to  work  for  the  following  com- 
plexity classes: 

2poly-log 

1 inear 

n1+c 

^nlog^n 

How  about  those  problems  for  which  lower  bound  proofs  have  already  been 
supplied?+  The  theorem  does  not  hold  for  any  elementary  lower  bound 
(functions  which  consist  of  bounded  nestings  of  exponentials  do  not  have  the 

hThis  issue  was  raised  by  R.  E.  Tarjan. 
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closure  properties  required  by  Her brand' s Theorem).  On  the  other  hand,  the 
A,.  sentence  for  those  sets  which  have  provable  nonelementary  lower  bounds 

IMS)  are  false  in  the  standard  model  of  T,  and  so  the  Issue  of  Independence 
does  not  even  arise  for  those  problems,  in  short,  the  theorem  cannot  apply 
to  a class  of  lower  bounds  F If  the  functions  In  F are  not  closed  under 
composlton  and  definition  by  cases,  or  If  determinism  and  nondeterminism  are 
not  distinguished  at  complexity  1. 

By  Identical  arguments  we  can  show  that  PT  Is  also  related  to  "P  “ NP." 
let  us  say  that  a theory  T can  verify  that  NP  Is  closed  under  complements 
If  for  S r NP 

T | "Sc  coNP." 

Corollary.  PT  can  verify  that  NP  Is  closed  under  complements  Iff  p » NP. 

By  "checking"  the  theorem  against  the  well-known  problems  which  lie  In 
NP  n coNP  (e.g..  Primes,  linear  Programming,  Breaking  Public  Key  Crypto- 
system l R1 ] ) , a great  deal  of  Information  can  be  obtained  about  the  nonstandard 
models  whose  existence  Is  so  Intimately  connected  to  lower  bounds.  We  have 
the  corollaries: 

Coral  1 ary . If  Primes  Is  not  In  P,  then  there  Is  a nonstandard  model  of  PT 
In  which  primes  need  not  have  primitive  roots  [Pr]. 

Corollary.  If  Linear  Programming  Is  not  In  P,  then  there  Is  a nonstandard 
inode  1 of  PT  In  which  for  some  point  y and  some  point-set  X whose  convex 
hull  does  not  contain  y,  there  Is  no  separating  hyperplane  through  y [Do]. 

Since  both  of  these  corollaries  negate  properties  which  hold  In  the 
standard  Integers,  It  Is  difficult  to  Imagine  the  models  In  which  they  fall. 
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Moreover,  the  classical  techniques  for  constructing  nonstandard  models  do  not 
work  at  the  simple  level  of  A<.(A,B).  For  example,  forcing  is  a technique  that 

can  be  applied  to  formulas  very  high  in  the  analytical  hierarchy  [Bu].  It  is 
generally  acknowledged  by  logicians  that  there  are  few  techniques  for  con- 
structing such  nonstandard  models,  yet  the  theorem  cited  above  asserts  that 
a byproduct  of  any  lower  bound  proof  Is  an  existence  proof  for  such  nonstandard 
models. 

Finally,  we  note  that  although  we  are  unable  to  extend  these  results  to 
Peano  Arithmetic,  we  can  extend  the  theory  PT  slightly  to  include  theories 
with  the  property  that  all  terms  which  grow  slowly  are  easy  to  compute.  Thus 
we  have  corresponding  independence  results  for  theories  of  + , * and  poly- 
nomial^ honest  functions.  For  instance,  suitable  theories  are  theories  of 

+ ,*,x.'  and  +,*,x^ 


IV.  Nonstandard  Models 

In  this  section  we  will  describe  a result,  due  to  R.  Solovay,  showing 
that  from  the  standpoint  of  constructing  nonstandard  models  the  theory  PT  is 
almost  as  strong  as  Peano  Arithmetic  (PA,  for  short).  We  begin  with  a 
digression  on  the  nature  of  nonstandard  models  of  PA  and  fragments  of  arithmetic. 

The  classical  observation  of  Skolem  was  that  a countable  nonstandard 
model  of  PA  could  be  obtained  simply  by  applying  compactness  to  the  set  of 
formulas 


PA  + (a>0)  + (a>l)  + (a>2)  + ... 


It  is  consistent  to  assume,  then,  that  there  exists  a "nonstandard  object"  a 
which  Is  greater  than  all  standard  Integers.  Such  a model  *N  contains  N as 
an  initial  segment  and  has  an  ordering  *<  extending  < to  *N-N.  The  global 





— - - 
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structure  of  *N  is  remarkable.  Define  for  x,y  e *N  x=y  to  mean  that  x and 
y differ  by  a standard  Integer,  i.e. , for  some  n e N: 

x*-y  * n or  y*-x  = n. 

*H/s  is  a set  of  equivalence  classes  called  blocks  (each  is  order  isomorphic 
to  N).  N is  a block.  Also  *<  totally  orders  blocks  like  the  rationals  (i.e., 
blocks  are  densely  ordered).  Nonstandard  integers  cannot  be  described  by 
formulas  of  PA  and  any  formula  true  of  infinitely  many  Integers  must  also  hold 
at  some  b e *N-N. 

Nonstandard  models  for  fragments  of  arithmetic  also  contain  Infinite, 
nonstandard  objects  but  may  have  vastly  simpler  structure.  Consider  the 
(infinite)  axiom  system:  for  all  n,  m e N, 

sucm(0)+Q  = sucm(0), 
sucm(0)+suc(sucn'(0))  * suc(sucnt+n(0)), 
sucn(0)x0  = 0, 

sucn(0)*suc(sucm(0) ) = sucn(0)*sucm(0)+sucn(0) , 
sucn(0)  t sucm(0),  for  m f n, 

(\fc)(x  1 sucm(0)  «-*  V x = suc’fO)), 

0<l£m 

(\fc)(x  < sucm(0)  v sucm(0)  £ x). 

A nonstandard  model  for  this  theory  is 
*N  - N u (u)},  w t N with  *suc(u>)  = 0, 

*suc(m)  3 suc(m)  for  all  m e N and  *+,  *x  defined  by  the  following  tables 
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X*(i) 

xcN 

*x 

X-Ul 

xcN 

y«w 

u> 

0) 

y-u) 

0 

0 

yeN 

<t> 

x+y 

ycN 

0 

x*y 

with 

As  another  example,  take  the  open 

the  induction  axiom 

theory  of  suc,pred,+ 

,*  and 

. together 

A(0)  A (Vx)[A(x)  -*•  A(suc(x)]  A(x),  A open 

A nonstandard  *N  consists  of  all  nonnegative  elements  Q(t)  of  the  ring  of 
polynomials 

P-1 

£ a a b. 

1-0  p_' 

Where  b,p,q  c N,  a^  c 1R  are  algebraic  and  Q(t)  *<  Q'(t)  Is  determined  by 
letting  t oo. 

This  model  is  quite  important  since  It  contains  a nonstandard  element  t V? 
such  that 

(t3v?)3  =>  t3  + t3, 

so  that  Fermat’s  Last  Theorem  for  m-3  fails  In  *N  (see  [Sh]  for  details). 

An  Important  aspect  of  these  weak  fragments  of  arithmetic  is  that  they 
can  have  "effective"  nonstandard  models,  such  as  the  two  models  described 
above.  That  is,  there  is  a recursive  definition  of  *+  and  *x  in  terms  of  an 
enumeration  of  the  universe. 

The  possibility  of  independence  from  PT  would  be  less  intriguing  if  PT 
turned  out  to  be  one  of  these  weak  fragments.  That  is,  if  a *N  such  that 
*N  ^(A.B)  could  be  found  in  which  *♦  and  *x  could  be  explicitly  defined 
by  finite  combinatorial  means.  In  fact,  PT  has  no  effective  nonstandard 
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models,  so  that  proofs  of  lower  bounds  are  necessarily  connected  with  the 
existence  of  nonrecursive  objects.  We  now  sketch  Solovay's  proof  of  this 
fact. 


We  first  need  the  corresponding  result  for  PA,  known  as  Tannenbaum's 
Theorem  (cf.  [Co]  and  [EK] ) : let  *N  be  a nonstandard  model  of  PA;  then 
at  least  one  of  *+  and  *x  must  be  nonrecursive.  The  key  idea  of  the  proof 
is  to  find  a nonstandard  object  y which  effectively  encodes  the  infinite 
membership  information  regarding  a nonrecursive  set  S.  This  can  be  done  as 
follows.  It  is  possible  in  PA  to  define  an  RE  nonrecursive  set  S.  In  *N, 

S is  *S.  If  p^  Is  the  1th  prime  in  *N,  the  Chinese  Remainder  Theorem  holds 
for  the  system 

y = bi  mod  p^,  P.  < c e *N  (6) 

Let  c e*N-H  and  define  the  bi  in  (6)  by: 

fo,  if  1 e S 
bi  { 

1.  if  i t S 


Information  in  y about  *S  is  decoded  as  follows:  search  *N  for  a z such  that 
Pnz  = y (i.e.,  n e *S)  or  pnz  = y-1  (i.e.,  n t *S).  If  *N  is  effective,  this 

procedure  is  effective  and  so  *S  n N is  a recursive  set.  It  is  not  hard  to 
see  that  S c *S  n N;  a contradiction  is  reached  by  constructing  a specific  S 
which  cannot  be  so  extended. 

Solovay's  argument  begins  by  noticing  that  although  PT  is  weaker  than 
PA,  the  only  thing  that  PT  lacks  is  the  ability  to  "talk  about"  growth 
arguments.  But,  let  *N  be  any  nonstandard  model  of  PT  and  let  c e *N-N  be 
a nonstandard  integer.  In  the  initial  segment  beneath  c there  is  a submodel 


^ i - - rr^j  \ 
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with  enough  "room"  for  the  argument  above  to  be  carried  out.  To  see  how  this 


can  happen  let 


*N.  ■ {xc*N| log  c x for  all  krNl. 


*N  Is  closed  under  polynomial  time  functions.  For  example  suppose  x c *N  . 

c 


1ogk*^c  *>  x,  for  all  k e 


and  so 


logkc  *>  2X  *>  x 2. 


Surprisingly,  *Nf  Is  also  a model  of  PT*  exponential.  This  follows  as  above: 


If  x c *N 


log  c *>  x,  for  all  k r N. 


k 2X  x 

ic  *>  2X 


Implies  2 c *NC  . 


Continuing  in  this  manner.  It  Is  possible  to  build  a model  *M  « *N  which 
Is  closed  under  enough  of  the  PA  definable  functions  to  let  the  proof  of 
Tannenbaum's  Theorem  be  carried  out.  But  then  the  recursiveness  of  *N  contra- 
dicts the  nonrecursiveness  of  *M. 


V.  Further  Discussion 


The  results  presented  above  show  that  lower  bound  proofs  are  exactly  as 
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difficult  as  independence  proofs.  This  In  itself  leads  to  interesting  spec- 
ulations, but  we  feel  the  real  force  of  these  results  lies  in  the  link  they 
create  between  the  relatively  new  (and  rather  concrete)  problems  of  computer 
science  and  some  classical  questions  at  the  foundations  of  mathematics.  We 
will  mention  just  a few  possibilities  which  ensue  from  such  a link. 

(1)  It  Is  possible  that  the  methods  of  mathematical  logic  may  help  us 
resolve  such  questions  as  whether  or  not  P ■ NP. 

(2)  Since  lower  bound  proofs  are  equivalent  to  independence  proofs, 
it  is  possible  that  the  lower  bound  statements  themselves  are 
independent  from  PA  or  similar  theorems.  We  make  the  following 
conjecture:  "P  * NP"  is  independent  of  PT. 

(3)  Following  the  measuring  of  (2),  a viable  approach  to  lower  bounds 
might  be  to  look  for  consistency  with  theories  such  as  PA  and  PT. 


(4)  It  is  possible  that  a nontrivial  lower  bound  will  be  proved,  providing 

* 

an  entirely  new  method  of  building  nonstandard  models  for  arithmetic. 


▼ 


J. 


1 

I 


I 

1 

I 


(5) 

(6) 


It  is  possible  that  T |-  A^(A,B)  Implying  the  existence  of  a poly- 
nomial but  quite  useless  algorithm  for  S. 

The  main  result  of  Section  III  together  with  Solovay's  result  comes 
very  close  to  explaining  the  difficulty  in  obtaining  lower  bounds: 
any  such  proof  must  implicitly  construct  a noneffective  system. 

This  makes  it  seem  far  less  likely  that  the  finite  combinatorial 
methods  of  the  sort  which  have  been  applied  in  extant  lower  bound 
proofs  will  be  able  to  prove  nontrivial  lower  bounds  are  NP-complete 
problems. 
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